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Abstract 



In 2009, Roglin and Teng showed that the smoothed number of Pareto optimal solutions 
of linear multi-criteria optimization problems is polynomially bounded in the number n of 
variables and the maximum density </> of the semi-random input model for any fixed number 
of objective functions. Their bound is, however, not very practical because the exponents grow 
exponentially in the number d -|- 1 of objective functions. In a recent breakthrough, Moitra 
and O'Donnell improved this bound significantly to 0{'n?'^4)'^'^'^+'^^''^) . 

An "intriguing problem", which Moitra and O'Donnell formulate in their paper, is how 
much further this bound can be improved. The previous lower bounds do not exclude the 
possibility of a polynomial upper bound whose degree does not depend on d. In this paper 
we resolve this question by constructing a class of instances with f2((n0)''''~'°^'''"''"'^^^"''^'' '*•'•') 
Pareto optimal solutions in expectation. For the bi-criteria case we present a higher lower 
bound of n(n^0^~®'^/'*^), which almost matches the known upper bound of O(n^0). 

1 Introduction 

In multi-criteria optimization problems we are given several objectives and aim at finding a solution 
that is simultaneously optimal in all of them. In most cases the objectives are conflicting and no 
such solution exists. The most popular way to deal with this problem is based on the following 
simple observation. If a solution is dominated by another solution, i.e. it is worse than the other 
solution in at least one objective and not better in the others, then this solution does not have to 
be considered for our optimization problem. All solutions that are not dominated are called Pareto 
optimal, and the set of these solutions is called Pareto set. 

Knapsack Problem with Groups Let us consider a variant of the knapsack problem which 
we call restricted multi-profit knapsack problem. Here, we have n objects oi, . . . ,a„, each with a 
weight Wi and a profit vector pi E M.'^ for a positive integer d. By a vector s € {0, 1}" we can 
describe which object to put into the knapsack. In this variant of the knapsack problem we are 
additionally given a set <S C {0, 1}" of solutions describing all combinations of objects that are 
allowed. We want to simultaneously minimize the total weight and maximize all total profits of a 
solution s. Thus, our optimization problem, denoted by Ks({ai, . . . ,a„}), can be written as 



n 



n 



minimize • Sj 

i=l 



and maximize Yl {Pi)j • Si for all j = 1, . . . , d 



subject to s in the feasible region <S. 



For S = {0, 1}" we just write K{{ai, . . . , a„}) instead of Ks{{ai, . . . , a„}). 

In this paper we will consider a special case of the optimization problem above where we 
partition the objects into groups. For each group a set of allowed subgroups is given. Independently 
of the choice of the objects outside this group we have to decide for one of those subgroups. Hence, 
the set S of solutions is of the form S — Y[i=i '^i where Si C {0, 1}"' and — We refer 

to this problem as multi-profit knapsack problem with groups. 

Smoothed Analysis For many multi-criteria optimization problems the worst-case size of the 
Pareto set is exponential in the number of variables. However, worst-case analysis is often too 
pessimistic, whereas average-case analysis assumes a certain distribution on the input universe, 
which is usually unknown. Smoothed analysis, introduced by Spielman and Teng |ST04) to explain 
the efficiency of the simplex algorithm in practice despite its exponential worst-case running time, 
is a combination of both approaches. Like in a worst-case analysis the model of smoothed analysis 
still considers adverserial instances. In contrast to the worst-case model, however, these instances 
are subsequently slightly perturbed at random, for example by Gaussian noise. This assumption is 
made to model that often the input an algorithm gets is subject to imprecise measurements, round- 
ing errors, or numerical imprecision. In a more general model of smoothed analysis, introduced by 
Beier and Vocking |BV04j, the adversary is even allowed to specify the probability distribution of 
the random noise. The influence he can exert is described by a parameter (j) denoting the maximum 
density of the noise. 

For the restricted multi-profit knapsack problem we use the following smoothing model which 
has also been used by Beier and Vocking [BV04 , by Beier, Roglin, and Vocking [BRV07 , by 
Roglin and Teng |RT09| . and by Moitra and O'Donnell |MO10j . Given positive inte gers n and d 
and a real ^ > 1 the adversary can specify a set 5 C {0, 1}" of solutions, arbitrary object weights 
wi, . . . , Wn and density functions fij : [—1, 1] — >■ K such that fij < 4>, i = 1, . . . ,n, j — 1, . . . ,d. 
Now the profits {pi)j are drawn independently according to the density functions fij. The smoothed 
number of Pareto optimal solutions is the largest expected size of the Pareto set of Ks{{ai, . . . , a„}) 
that the adversary can achieve by choosing the set S, the weights Wi, and the probability densities 
fi,j ^ for the profits {pi)j. 

Previous Work Beier and Vocking |BV04] showed that for d = 1 the expected size of the Pareto 
set is 0{n'*'(f)). Furthermore, they showed a lower bound of ft (n^) if all profits are uniformly drawn 
from [0,1]. Later, Beier, Roglin, and Vocking [B RV07j improved the upper bound to 0{n'^(j)) by 
analyzing the so-called loser gap. Roglin and Teng |RT09j generalized the notion of this gap to 
higher dimensions, i.e. d > 2, and gave the first polynomial bound in n and (f) for the smoothed 
number of Pareto optimal solutions. Furthermore, they were able to bound higher moments. The 
degree of the polynomial, however, was d®^'^). Recently, Moitra and O'Donnell ,MO10^ showed a 
bound of O(7i^'^0'^*^'^+^^/^), which is the first polynomial bound for the expected size of the Pareto 
set with degree polynomial in d. An "intriguing problem" with which Moitra and O'Donnell 
conclude their paper is whether their upper bound could be significantly improved, for example 
to f{d, 4))n^ . Moitra and O'Donnell suspect that for constant </> there should be a lower bound of 
il (n'^) . In this paper we resolve this question almost completely. 

Our Contribution For d = 1 we prove a lower bound n (min 2®*^"'}). This is the 

first bound with dependence on n and (j) and it nearly matches the upper bound 0(min {n^cj), 2"}). 
For d > 2 we prove a lower bound (min { (n0)(''-i°g2(d))-(i-e(i/<#'))^ 2'3(")}) . This is the first bound 
for the general multi-criteria case. Still, there is a significant gap between this lower bound and 
the upper bound of 0(min |n^'*(/)'*'^'^+^)/^, 2"}) shown by Moitra and O'Donnell, but the exponent 
of n is nearly d — logj (d). Hence our lower bomid is close to the lower bound of (n'^) conjectured 
by Moitra and O'Donnell. 
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2 The Bi-criteria Case 



In this section we present a lower bound for the expected number of Pareto optimal solutions in 
bi-criteria optimization problems that shows that the upper bound of Beier, Roglin, and Vocking 
|BRV07) cannot be significantly improved. To prove this lower bound, we consider a class of 
instances for a variant of the knapsack problem, in which subsets of items can form groups such 
that either all items in a group have to be put into the knapsack or none of them. 

Theorem 1. There is a class of instances for the bi-criteria knapsack problem with groups for 
which the expected number of Pareto- optimal solutions is lower bounded by 



nil 



where n is the number of objects and 4> is the maximum density of the profits ' probability distribu- 
tions. 

Note, that Beier, Roglin, and Vocking |BRV07j proved an upper bound of 0(min {rt^(/), 2"}). 
That is, the exponents of n and in the lower and the upper bound are asymptotically the same. 
For our construction we use the following lower bound from Beier and Vocking. 



Theorem 2 ( |B V04] ) . Let ai, . . . , a„ be objects with weights 2^, . . . , 2" and profits pi, . . . ,p„ that 
are independently and uniformly distributed in [0, 1]. Then, the expected number of Pareto optimal 
solutions of _fir({ai, . . . , a„}) is VI (n^) ■ 

Note that scaling all profits does not change the Pareto set and hence Theorem [2] remains true if 
the profits are chosen uniformly from [0, a] for an arbitrary a > 0. We will exploit this observation 
later in our construction. 

The idea how to create a large Pareto set is what we call the copy step. Let us assume we have 
an additional object b with weight 2"+^ and fixed profit q. The solutions from K{{ai, . . . , a„, b}) 
can be considered as solutions from K{{ai, . . . ,a„}) that do not use object b or as solutions from 
K{{ai, . . . , a„}) that additionally use object b. By the choice of the weight of b, a Pareto optimal 
solution from K{{ai, . . . , a„}) is also a Pareto optimal solution from K({ai, . . . , a„, b}) as object b 
alone is heavier than all objects ai, . . . , a„ together. The crucial observation is that a solution that 
uses object b is Pareto optimal if and only if its profit is larger than the largest profit of any Pareto 
optimal solution from K{{ai, . . . , a„}) and if it is Pareto optimal for K{{ai, . . . , a„}) when not 
using b. The first condition is always fulfilled if we choose the profit q large enough. In this case 
we can view the Pareto optimal solutions using object b as copies of the Pareto optimal solutions 
that do not use b. 

Lemma 3. Let oi, . . . , a„ be objects with weights 2^, . . . , 2" and profits pi, . . . ,p„ > and let b 
be an object with weight 2"+^ and profit q > X^ILiPi- Furthermore, let V denote the Pareto set 
of K({ai, . . . , an}) and let V' denote the Pareto set of K{{ai, ... ,an,b}). Then, V' is the disjoint 
union ofV^ := {(s,0) : s € P} and V'^ := {(s, 1) : s € V} and thus \'P'\ = 2 • jT']. 

Figure [l] visualizes the proof idea. If we represent all solutions by a weight-profit pair in the 
weight-profit space, then the set of solutions using object h is the set of solutions that do not 
use object 6, but shifted by (2"+^,(7). As both components of this vector are chosen sufficiently 
large, there is no domination between solutions from different copies and hence the Pareto optimal 
solutions of K{{ai, . . . , a„, 6}) are just the copies of the Pareto optimal solutions of K{{ai, . . . , a„}). 
Now we use the copy idea to construct a large Pareto set. Let oi, . . . , a„p be objects with weights 
2^, . . . , 2"p and with profits pi,. . . ,p„p G P := [0, ^] where </) > 1, and let &i, . . . , bn^ be objects 
with weights 2"p+^, . . . , 2""+"' and with profits 



where mi 



+ 1 / 20- 1 
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Figure 1: The copy step. The Pareto set V' consist of two copies of the Pareto set V. 



To apply LemmajS] we first have to show that we chose the intervals Qi appropriately. Additionally, 
we implicitely show that the lower boundaries of the intervals Qi are non-negative. 



Lemma 4. Letpi, . . . ,pnp G P and let Qi E Qi- Then, qi > X]j=i Pj+X]j=i 1j '^^^ i = I, ■ 
Proof. Using the definition of m^, we get 



Qi > rrii 



> rrii 



rrii + l 



1 {2(f)- ^ 1 



- 1 



and 
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2(?i- 1 
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□ 



Combining Theorem [2] Lemma [3] and Lemma |4j we immediately get a lower bound for the 
knapsack problem using the objects Oi, . . . , a^^ and 6i, . . . , with profits chosen from P and Qi, 
respectively. 

Corollary 5. Let ai, . . . , a„^ and 6i, . . . , be as above, but the profits pi are chosen uniformly 
from P and the profits qi are arbitrarily chosen from Qi. Then, the expected number of Pareto 
optimal solutions of K{{ai, . . . , a„p, bi, . . . , is (rip ■ 2"') . 

Proof. Because of Lemma |4j we can apply Lemma |3] for each realization of the profits pi, . . . , Pn^ 
and gi , . . . , ■ This implies that the expected number of Pareto optimal solutions is 2"'' times the 
expected size of the Pareto set of K{{ai, . . . , a„p}) which is ft (n^) according to Theorem [2| □ 

The profits of the objects hi grow exponentially and leave the interval [0, 1]. We resolve this 



problem by splitting each object bi into fc^ := [to^] objects b['^\ . . . , b^'''' with the same total weight 
and the same total profit, i.e. with weight 2"p+YA:i and profit 

qf G Q^/k^ : 



mi 
ki 



1- 

6' ki 
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As the intervals Qi are subsets of K+, the intervals Qi/ki are subsets of [0, 1]. It remains to ensure 
that for any fixed i all objects b^P are treated as a group. This can be done by restricting the set S 
of solutions. Let Si = {(0, . . . , 0), (1, . . . , 1)} C {0, 1}*^'. Then, the set S of solutions is defined as 

rig 

5:={0,lp x[]5,. 

i=l 

By choosing the set of solutions that way, the objects fo^', . . . , hf^^ can be viewed as substitute for 
object bi. Thus, a direct consequence of Corollary [5] is the following. 

Corollary 6. Let S , ai, . . . , a„p and b^ he as above, and let the profits pi, . . . be chosen uni- 
formly from P and let the profits . . . , g^'^''* be chosen uniformly from Qi/ki. Then, the expected 

number of Pareto optimal solutions of Ks{{ai, . . . , a„ } U {b^ : i = 1, . . . , Uq, I — 1, . . . , ki}) is 
r^(n2.2"'). 

The remainder contains just some technical details. First, we give an upper bound for the 
number of objects bf\ 

Lemma 7. The number of objects b^ is upper bounded by Uq + ^^^^ ■ {j^iiY^ 
Proof. The number of objects fcf ' is Y^^li — X^T^i T"^*! + X]"=i ^'^'^ 



Now we are able to prove Theorem [Ij 

Proof of Theorem^ Without loss of generality let n > 4 and (f> > ~ 2.62. For the moment 

let us assume < ( ^^5f ) • This is the interesting case leading to the first term in the minimum 

in Theorem jlj We set := J°^2f-i ^ e [1, ^] and fip := ""^""^ > ^ > 1. All inequalities 

hold because of the bounds on n and (j). We obtain the numbers Hp and Uq by rounding, i.e. 
Hp :— [fipl > 1 and Uq := \nq\ > 1. Now we consider objects ai,...,a„p with weights 2* and 

profits chosen uniformly from P, and objects &f \ z = 1, . . . , n,, ^ = 1, . . . , fc^, with weights 2"^+*/^* 
and profits chosen uniformly from Qi/ki. Observe that P and all Qi/ki have length ^ and thus the 
densities of all profits are bounded by </>. Let TV be the number of all these objects. By Lemma [7j 
this number is bounded by 

A* < n„ + no H — • — — < n, ' " ' 



20-1 



flp + 1 

= Up + Uq ^ ^ — • (j) — 2np + Uq + 1 ~ n . 

Hence, the number A^ of binary variables we actually use is at most n, as required. As set of 



solutions we consider S :~ {0, 1}"'' x Y[ ^i. Due to Corollary 



set of Ks{{ai, . . . ,a„p} U {bf'' : i^l,...,nq, 1^1,..., fcj) is 



1=1 



the expected size of the Pareto 



log(0) 
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where the last step holds because 



log, (2+^) log (2 



e(i) 



for any constants Ci,C2 > 0. We formulated this argument slightly more general than necessary as 
we will use it again in the multi-criteria case. 

In the case (j) > (^^?r)^^ construct the same instance as above, but for maximum den- 
sity (j}' > 1 where 0' = ( '^^ili ) ■ Since n > 4, the value (j)' exists, is unique and 0' G 
As above, the expected size of the Pareto set is 



los(.»') 



'A'f^) = n (n^ . 2"^") ^n{n^- 2«(")) n (2«(")) . □ 



3 The Multi-criteria Case 

In this section we present a lower bound for the expected number of Pareto optimal solutions in 
multi-criteria optimization problems. For this, we construct a class of instances for a variant of 
the knapsack problem where each object has one weight and d profits and where objects can form 
groups. We restrict our attention to d > 2 as we discussed the case d = 1 in the previous section. 

Theorem 8. For any fixed integer d > 2 there is a class of instances for the (d + 1) -dimensional 
knapsack problem with groups for which the expected number of Pareto- optimal solutions is lower 
bounded by 

n (min{(,i0)('^-'°sW)-(i-e(i/«)^2Q(")}) , 

where n is the number of objects and (j) is the maximum density of the profit's probability distribu- 
tions. 

Unfortunately, Theorem [H] does not generalize Theorem [T] This is due to the fact that, though 
we know an explicit formula for the expected number of Pareto optimal solutions if all profits 
are uniformly chosen from [0, 1], we were not able to find a simple non-trivial lower bound for it. 
Hence, in the general multi-criteria case, we concentrate on analyzing the copy and split steps. 

In the bi-criteria case we used an additional object b to copy the Pareto set (see Figure [T]). For 
that we had to ensure that every solution using this object has higher weight than all solutions 
without b. The opposite had to hold for the profit. Since all profits are in [0, 1], the profit of every 
solution must be in [0, n]. As the Pareto set of the first rip < n/2 objects has profits in [0, n/ (20)], 
we could fit rig = (log (</>)) copies of this initial Pareto set into the interval [0,n]. 

In the multi-criteria case, every solution has a profit in [0,71]'*. In our construction, the initial 
Pareto set consists only of a single solution, but we benefit from the fact that the number of 
mutually non-dominating copies of the initial Pareto set that we can fit into the hypercube [0,n]'^ 
grows quickly with d. 

Let us consider the case that we have some Pareto set V whose profits lie in some hyper- 
cube [0,a]''. We will create (^^^) copies of this Pareto set; one for every vector x € {0,1}'* with 

exactly dh = \d/2~\ ones. Let x G {0, 1}'* be such a vector. Then we generate the corresponding 
copy Cx of the Pareto set V by shifting it by a -I- e in every dimension i with Xi — 1. If all solutions 
in these copies have higher weights than the solutions in the initial Pareto set V, then the initial 
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Pareto set stays Pareto optimal. Furthermore, for each pair of copies and Cy, there is one 
index i with Xi = I and yi = 0. Hence, sohitions from Cy cannot dominate solutions from Cx- 
Similarly, one can argue that no solution in the initial copy can dominate any solution from Cx- 
This shows that all solutions in copy Cx are Pareto optimal. All the copies (including the initial 
one) have profits in [0, 2a + e]'^ and together |P| • (l + {^J) > |P| • 2''/d solutions. 

We start with an initial Pareto set of a single solution with profit in [0, 1/4']'^, and hence we 
can make 9 (log {n4>)) copy steps before the hypercube [0,n]'^ is filled. In each of these steps the 
number of Pareto optimal solutions increases by a factor of at least 2'^/ d, yielding a total number 
of at least 

r,d \ ©(log(n0)) 

M = (n<^)e(<^-i°gW) 

Pareto optimal solutions. 

In the following, we describe how these copy steps can be realized in the restricted multi-profit 
knapsack problem. Again, we have to make a split step because the profit of every object must be 
in [0, 1]''. Due to such technicalities, the actual bound we prove looks slightly different than the 
one above. It turns out that we need (before splitting) d new objects 6i, . . . , 6^ for each copy step 
in contrast to the bi-criteria case, where (before splitting) a single object b was enough. 

Let Ug > 1 he an arbitrary positive integer and let (j) > 2d he a real. We consider objects bij 
with weights 2^/dh, and profit vectors 

\mi\ 



i-i r 



Qij G Qi,j := Yl ^' 
fe=i 

where rrii is recursively defined as 
mo := and rrii := 



X m 



-,nii 


a 

X n 






k=j+l 





i = l,...,nq. 



(1) 



The explicit formula for this recurrence is 



rrii 



d 




l,...,ng. 



The d-dimcnsional interval Qi j is of the form that the j profit of object bij is large and all the 
other profits are small as discussed in the motivation. 

Let H{x) he the Hamming weight of a 0-1-vector x, i.e. the number of ones in x, and let 
S :— {x G {0, 1}'' : H{x) £ {0, dh}} denote the set of all 0-1-vectors of length d with or dh ones. 
As set S of solutions we consider S := 

Lemma 9. Let the set S of solutions and the objects bi_j he as above. Then, each solution s £ S 



is Pareto optimal for Ks{{bi 



1, 



J 



1, 



,,4). 



Proof. We show the statement by induction over Uq and discuss the base case and the inductive 
step simultaneously because of similar arguments. Let S' := 5"""^ and let (s, s„^) e 5' x 5 be an 
arbitrary solution from S. Note that for = 1 we get s — \, the 0-1-vcctor of length 0. First we 
show that there is no domination within one copy, i.e. there is no solution of type (s', s„^) € S that 
dominates (s, Sn,)- For = 1 this is obviously true. For Uq > 2 the existence of such a solution 
would imply that s' dominates s in the knapsack problem Ksi{{bij : i = l,...,ng — 1, j 

I d}). This contradicts the inductive hypothesis. 

Now we prove that there is no domination between solutions from different copies, i.e. there 
is no solution of type {s',s'^ ) G S with s'^ ^ that dominates (s, Sn,)- If = 0, then the 
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total weight of the solution (s,s„^) is at most X^i^i ^ 2' < 2"'. The right side of this inequality 
is a lower bound for the weight of solution (s',s^^) because s^^ ^ s„^. Hence, (s',s^_^) does not 

dominate (s, s„^). Finally, let us consider the case s„^ 7^ 0. There must be an index j e [d] where 
{sn^)j = 1 and {s'„^)j = 0. We show that the j"^ total profit of (s, s„^) is higher than the j^^ profit 
of (s', sj^ ). The former one is strictly bounded from below by m„^ — [wn,] whereas the latter 
one is bounded from above by 



\mi'] 



-,TO, 



Solution (s', ) can use at most dh objects of each group bi^i, . . . , bi,d. Each of them, except one. 



can contribute at most 



to the j total profit. One can contribute either at most 



or at 



most rrii. This argument also holds for the n*^ group, but by the choice of index j we know that 
each object chosen by s^^ contributes at most -1^^ to the j*"^ total profit. It is easy to see that 
Inii] /4> < rrii because of > d > 1. Hence, our bound simplifies to 

n„— 1 



\mi'] 



dh 



^E 

1=1 

1 / 



Y^^{m, ■ {(j) + d) + d) + d ■ (m„, + 1)^ - 
E ("^. • (0 + d) + rf) + d • m„, ^ 



(d> 2) 



i=0 



< m, 



{{4> - d) ■ nin^ + d ■ m„J 



(mo = 0) 
(Equation (ll 



This implies that (s', ) does not dominate (s, s„^ 



□ 



Immediately, we get a statement about the expected number of Pareto optimal solutions if we 
randomize. 

Corollary 10. Let S and bij be as above, but the profit vectors qij are arbitrarily drawn from Qi j . 
Then, the expected number of Pareto optimal solutions for Ks({bi j : z = 1, . . . , n^, j — 1, . . . , d}) 

IS at least 1^1 

Proof. This result follows from Lemma [9] and the fact 



1^1 



> 1 



' - 1 2'^ 

> — 

d - d 



As in the bi-criteria case we now split each object bij into ki 
with weights 2^ /(ki ■ dh) and with profit vectors 



\mi\ objects b 



(1) 



□ 



n 

k=l 



"•5 


^ / mj 1 mj 
\ki (j)' ki _ 


d 

X n 
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Then, we adapt our set S of solutions such that for any fixed in dice s i and j either all objects 



(1) (k- I 

b- ' , . . . ,bl are put into the knapsack or none of them. Corollary 10 yields the following result. 



Corollary 11. Let S and 6^'^ be as described above, but the profit vectors p'^j , . . . ip'fj^ are chosen 
uniformly from Qij/ki. Then, the expected number of Pareto optimal solutions of Ks({bf^j : i = 

^ ) 

Still, the lower bound is expressed in Uq and not in the number of objects used. So the next 
step is to analyze the number of objects. 

Lemma 12. The number of objects bf'j is upper bounded by d ■ Ug + ' (;/)^) 

Proof. The number of objects is J^^Zii^ ■ h) = d ■ T'^il d ■ Uq + d ■ rui, and 



d ^ / 2(/) V d 



d ^-^^\(j) — dj 4> + d 



< 



\<l>-dj 



- (t>\(j)~dj \(l)-dj (t)-d\(j)-d) ■ 

Now we can prove Theorem |8] 

Proof of Theorem^ Without loss of generality let n > 16d and > 2d. For the moment let 
us assume 4> — d < ^ • (y-^^zr^ ''' ■ This is the interesting case leading to the first term in the 

minimum in Theorem jsj We set fiq := ^[^'^^ ^ G l-*^' 5s] ^^'^ obtain Uq := [hq\ > 1 by 

rounding. All inequalities hold because of the bounds on n and (f). Now we consider objects bf}^, 
i = 1, . . . , Uq, j = 1, . . . ,d, I = 1, . . . ,ki, with weights 2*/ {ki ■ d) and profit vectors qij chosen 
uniformly from Qij/ki. All these intervals have length ^ and hence all densities are bounded 
by (p. Let N be the number of objects. By Lemma [121 this number is bounded by 



2^2 f 2(t) Y" ^ ^ ^ _ 2^2 f 20 
a 

2d^ , . ,^ n 



<d-nq + — -i^-d)-—^<n. 

Hence, the number N of binary variables we actually use is at most n, as required. As set S 
of solutions we use the set described above, encoding the copy step and the split step. Due to 
Corollary [nj for fixed d > 2 the expected number of Pareto optimal solutions of Ks{{bfj : i — 
l,...,nq, J =]l,...,]d, I = l,...,fcj) is 



d-loE2(d) 



where the last step holds because of the same reason as in the proof of Theorem [T] 
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In the case (f> — d > — • (^^z^ j we construct the same instance above, but for a maximum 

density (j)' > d where (p' ~ d — ^ ■ ^"^ . Since n > 16d, the value (j)' exists, is unique and 

(p' £ [65d, (p). Futhcrmore, we get nq — As above, the expected size of the Pareto set is 
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